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BACKGROUND OF THE INVENTION 
Technical Field of the Invention 

[0002] The present invention relates generally to executing programs and more particularly, to 
improve the utilization of memory resources by executing a garbage collector. 

Background Information 

[0003] Many types of electronic devices are battery operated and thus preferably consume as little 
power as possible. An example is a cellular telephone. Further, it may be desirable to implement 
various types of multimedia functionality in an electronic device such as a cell phone. Examples 
of multimedia functionality may include, without limitation, games, audio decoders, digital 
cameras, etc. It is thus desirable to implement such functionality in an electronic device in a way 
that, all else being equal, is fast, consumes as little power as possible and requires as little memory 
as possible. Improvements in this* area are desirable. > 

e 

BRIEF SUMMARY OF THE PREFERRED EMBODIMENTS 
[0004] As disclosed herein, a system (e.g., a cellular telephone) comprises a counter capable of 
monitoring the usage of memory resources for program execution. The counter monitors the usage 
of the allocated space and a garbage collector execution is conditioned upon reaching or surpassing 
a threshold value for the counter. The garbage collector evaluates the state of the memory and 
frees memory that has been consumed by programs and is not needed a 

[0005] The system includes a processor that decodes instructions (e.g., standard Java instructions) 
some of which cause memory request allocation, but may not indicate how much memory is 
precisely needed directly in the instruction. In this case the decoder may provide information to 



increment a counter, preferably in hardware, that may indicate the number of memory allocations 

> 

instead the exact amount of memory used. 

[0006J The system may also include a micro-sequence or a software task that replaces instructions 
that request memory resources. During the execution of the micro-sequence or the software task, 
the counter is updated with the precise memory amount requested, and will increment as the 
memory is consumed. 

[0007] When the counter reaches a pre-determined threshold value, either an interruption is 
generated to signal the need for garbage collection or the JVM or any software task that would 
initiate the garbage collector task may check the counter periodically to decide when to start 
garbage collection. The garbage collector frees unused memory and updates the memory use 
counter accordingly. The counter may be implemented in software or in hardware. 



NOTATION AND NOMENCLATURE 
[0008] Certain terms are used throughout the following description and claims to refer to particular 

system components. As one skilled in the art will appreciate, various companies may refer to a 

component by different names. This document does not intend to distinguish between components 

that differ in name but not function. In the following discussion and in the claims, the terms 

"including" and "comprising" are used in an open-ended fashion, and thus should be interpreted to 

mean "including, but not limited to. . .". Also, the term "couple" or "couples" is intended to mean 

either an indirect or direct connection. Thus, if a first device couples to a second device, that 

connection may be through a direct connection, or through an indirect connection via other devices 

and connections. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0009] For a more detailed description of the preferred embodiments of the present invention, 
reference will now be made to the accompanying drawings, wherein: 

[0010] Figure 1 shows a diagram of a system in accordance with preferred embodiments of the 

invention and including a Java Stack Machine ("JSM") and a Main Processor Unit ("MPU"); 

♦ 

[0011] Figure 2 shows a block diagram of the JSM of Figure 1 in accordance with preferred 
embodiments of the invention; 

[0012] Figure 3 shows various registers used in the JSM of Figures 1 and 2; and 

[0013] Figure 4 illustrates a block diagram of a system in accordance with preferred 

embodiments of the invention including a Main Processor Unit ("MPU") and a garbage collector. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0014] The following discussion is directed to various embodiments of the invention. Although 
one or more of these embodiments may be preferred:, the embodiments disclosed should not be 
interpreted, or otherwise used, as limiting the scope of the disclosure, including the claims, unless 
otherwise specified. In addition, one skilled in the art will understand that the following 
description has broad application, and the discussion of any embodiment is meant only to be 
exemplary of that embodiment, and not intended to intimate that the scope of the disclosure, 
including the claims, is limited to that embodiment. 

[0015] The subject matter disclosed herein is directed to a programmable electronic device such as 
a processor. The processor described herein may be particularly suited for executing Java™ 
Bytecodes, or comparable code. As is well known, Java is particularly suited for embedded 
applications and is a relatively "dense" language meaning that on average, each instruction may 
perform a large number of functions compared to various other programming languages. The 
dense nature of Java is of particular benefit for portable, battery-operated devices that preferably 
include as little memory as possible to save space and power. The reason, however, for executing 
Java code is not material to this disclosure or the claims that follow. Further, the embodiment of 
the invention may be described in the context of Java, but should not be limited to the execution of 
only Java instructions. The processor described herein may be used in a wide variety of electronic 
systems (e.g., cell phones). 

[0016] Referring now to Figure 1, a system 100 is shown in accordance with a preferred 
embodiment of the invention. As shown, the system includes at least two processors 102 and 104. 
Processor 102 is referred to for purposes of this disclosure as a Java Stack Machine ("JSM") and 
processor 104 may be referred to as a Main Processor Unit ("MPU"). System 100 may also 



include memory 106 coupled to both the JSM 102 and MPU 104 and thus accessible by both 
processors. At least a portion of the memory 106 may be shared by both processors meaning that 
both processors may access the same shared memory locations. Further, if desired, a portion of the 
memory 106 may be designated as private to one processor or the other. System 100 also includes 
a Java Virtual Machine ("JVM") 108, compiler 110, and a display 114. The JSM 102 preferably 
includes an interface to one or more input/output ("I/O") devices such as a keypad to permit a user 
to control various aspects of the system 100. In addition, data streams may be received from, the 

♦ 

I/O space into the JSM 102 to be processed by the JSM 102. Other components (not specifically 
shown) may be included as well. 

[0017] As is generally well known, Java code comprises a plurality of "Bytecodes" 1 12. 
Bytecodes 112 may be provided to the JVM 108, compiled by compiler 110 and provided to the 
JSM 102 and/or MPU 104 for execution therein. In accordance with a preferred embodiment of 
the invention, the JSM 102 may execute at least some, and generally most, of the Java Bytecodes. 
When appropriate, however, the JSM 102 may request the MPU 104 to execute one or more Java 
Bytecodes not executed or executable by the JSM 102. In addition to executing Java Bytecodes, 
the MPU 104 also may execute non-Java instructions. The MPU 104 also hosts an operating 
system ("O/S") (not specifically shown), which performs various functions including system 
memory management, the system task management that schedules the JVM 108 and most or all 
other native tasks running on the system, management of the display 114, receiving input from 
input devices, etc. Without limitation, Java code may be used to perform any one of a variety of 
applications including multimedia, games or web-based applications in the system 100, while non- 
Java code, which may comprise the O/S and other native applications, may still run on the system 
on the MPU 104. 



[0018] The JVM 108 generally comprises a combination of software and hardware. The software 
may include the compiler 1 10 and the hardware may include the JSM 102. The JVM may include a 
class loader, Bytecode verifier, garbage collector, and a Bytecode interpreter loop to interpret the 
Bytecodes that are not executed on the JSM processor 102. 

[0019] In accordance with preferred embodiments of the invention, the JSM 102 may execute at 
least two instruction sets. One instruction set may comprise standard Java Bytecodes. As is well 
known, Java is a stack-based programming language in which instructions generally target a stack. 
For example, an integer add ("I ADD") Java instruction pops two integers off the top of the stack, 
adds them together, and pushes the sum back on the stack. In general, the JSM 102 comprises a 
stack-based architecture with various features that accelerate the execution of stack-based Java 
code. 

[0020] Another instruction set executed by the JSM 102 may include instructions other than 
standard Java instructions. In accordance with at least some embodiments of the invention, such 
other instruction set may include register-based and memory-based instructions. This other 
instruction set generally complements the Java instruction set and, accordingly, may be referred to 
as a complementary instruction set architecture ("C-ISA") such as those instructions disclosed in 
one or more of the previously listed co-pending applications included herein by reference. By 
complementary, it is meant that at least some Java Bytecodes may be replaced by micro-sequences 
using C-ISA instructions that permit address calculation to readily "walk through" the JVM data 
structures. A micro-sequence may comprise one or more C-ISA instructions. Further, such micro- 
sequences may also include Java Bytecode instructions. The execution of Java may be made more 
efficient and run faster by replacing some sequences of Bytecodes by preferably shorter and more 
efficient sequences of C-ISA instructions. The two sets of instructions may be used in a 



complementary fashion to obtain satisfactory code density and efficiency. As such, the JSM 102 
generally comprises a stack-based architecture for efficient and accelerated execution of Java 
Bytecodes combined with a register-based architecture for executing register and memory based C- 
ISA instructions. Both architectures preferably are tightly combined and integrated through the C- 
ISA. 

[0021] Figure 2 shows an exemplary block diagram of the JSM 102. As shown, the JSM includes 
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a core 120 coupled to data storage 122 and instruction storage 130. The core may include one or 
more components as shown. Such components preferably include a plurality of registers 140, three 
address generation units ("AGUs") 142, 147, micro-translation lookaside buffers (micro-TLBs) 
144, 156, a multi-entry micro-stack 146, an arithmetic logic unit ("ALU") 148, a multiplier 150, 
decode logic 152, and instruction fetch logic 154. In general, operands may be retrieved from data 
storage 122 or from the micro-stack 146, processed by the ALU 148, while instructions may be 
fetched from instruction storage 130 by fetch logic 154, pre-decoded by pre-decode logic 158, and 
decoded by decode logic 152. The address generation unit 142 may be used to calculate addresses 
based, at least in part on data contained in the registers 140. The AGUs 142 may calculate 
addresses for C-ISA instructions as will be described below. The AGUs 142 may support parallel 
data accesses for C-ISA instructions that perform array or other types of processing. AGU 147 
couples to the micro-stack 146 and may manage overflow and underflow conditions in the micro- 
stack preferably in parallel. The micro-TLBs 144, 156 generally perform the function of a cache 
for the address translation and memory protection information bits that are preferably under the 
control of the operating system running on the MPU 104. The decode logic 152 may be adapted to 
execute both the standard Java instructions as well as the C-ISA instructions of the system. 



[0022] Referring now to Figure 3, the registers 140 may include 16 registers designated as R0- 
R15. Registers R0-R3, R5, R8-R11 and R13^R14 may be used as general purposes ("GP") 

* 

registers usable for any purpose by the programmer. Other registers, and some of the GP registers, 
may be used for specific functions. For example, registers R4 and R12 may be used to store two 
program counters. Register R4 preferably is used to store the program counter ("PC") and register 
R12 preferably is used to store a micro-program counter ("micro-PC"). In addition to use as a GP 
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register, register R5 may be used to store the base address of a portion of memory in which Java 
local variables may be stored when used by the current Java method. The top of the micro-stack 
146 is referenced in registers R6 and R7. The top of the micro-stack has a matching address in 
external memory pointed to by register R6. The values contained in the micro-stack are the latest 
updated values, while their corresponding values in external memory may or may not be up to 
date. Register R7 provides the data value stored at the top of the micro-stack. Registers R8 and 
R9 may also be used to hold the address index 0 ("AI0") and address index 1 ("All"). Register 
R14 may also be used to hold the indirect register index ("IRI"). Register R15 may be used for 
status and control of the JSM 102. JSM 102 also may have some additional memory mapped 
registers not shown in Figure 2 that includes various control or configuration information usually 
set by the MPU 104^ The counter and threshold described below may be part of those registers. 
[0023] Referring again to Figure 2, as noted above, the JSM 102 may execute stack-based 
instructions and thus the JSM includes a hardware-based micro-stack 146 for storing operands. 
Unless empty, Java Bytecodes pop data from and push data onto the micro-stack 146. The micro- 
stack 146 preferably comprises at most the top n entries of a larger stack that may be implemented 

■ 

in data storage 122. Although the value of n may be vary in different embodiments, in accordance 
with at least some embodiments, the size n of the micro-stack may be the top eight entries in the 



larger, memory-based stack. The micro-stack 146 preferably comprises a plurality of gates in the 
core 120 of the JSM 102. By implementing the micro-stack 146 in gates (e.g., registers) in the core 
120 of the processor 102, access to the data contained in the micro-stack 146 is generally very fast, 
although any particular access speed is not a limitation on this disclosure. 

[0024] The ALU 148 adds, subtracts, and shifts data and may be adapted to completely execute 
instructions in less than two cycles. The multiplier 150 may be used to multiply two values 
together in one or more cycles. The instruction fetch logic 154 generally fetches instructions from 
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instruction storage 130. The decoder 152 may then decode the instructions. 
[0025] The data storage 122 generally comprises data cache ("D-cache") 124 and data random 
access memory ("D-RAMset") 126. Reference may be made to copending applications U.S. Serial 
Nos. 09/591,537 filed June 9, 2000 (atty docket TI-29884), 09/591,656 filed June 9, 2000 (atty 
docket TI-29960), and 09/932,794 filed August 17, 2001 (atty docket TI-31351), all of which are 
incorporated herein by reference. The stack (excluding the micro-stack 146), arrays and non- 
critical data may be stored in the D-cache 124, while Java local variables, critical data and non- 
Java variables (e.g., C, C++) may be stored in D-RAM 126. The instruction storage 130 may 
comprise instruction RAM ("I-RAM") 132 and instruction cache ("I-cache") 134. The I-RAMset 
132 may be used for relatively complex micro-sequenced Bytecodes or other micro-sequences or 
critical sequences of codes. The I-cache 134 may be used to store other types of Java Bytecode 
and mixed Java/CISA instructions. 

* 

[0026] As is well known, programs may be executed on processors, such as the JSM 102 or the 
MPU 104, where each program is allocated a portion of the memory to utilize. Some of the 
memory is allocated dynamically during the execution of a program, others statically when the 
program is launched. Programs that allocate memory dynamically preferably free the memory 



allocated when they do not require it anymore. For example, a program in C may use "malloc( )" 
and "free( )" library functions to free up memory allocation not needed by the program. In 
instances where these programs do not free the unused memory correctly, memory leaks occur and 
usually cause the system to crash after some time. Such events are well known by programmers as 
a typical fatal error in system called "out of memory error". Java programmers do not need to 
worry about memory recollection when they write Java programs because the memory re- 
collection in Java is done by a garbage collection task embedded into the JVM. The garbage 
collection task is independent from the executed Java program and may monitor the allocated 
memory that can be recycled and put back into the available memory space. 
[0027] The recycled memory may subsequently be re-allocated to programs when a new memory 
allocation request occurs through instructions, such as "New" or "New Array" Java Bytecode, 
Typically, the garbage collector is a timed operation, where at a certain time interval, the processor 
will stall, and the garbage collector is initiated to evaluate the usage of memory space. However, 
in some instances, the garbage collector may not be needed, and thus causing the processor to 
unnecessarily stall the current program execution and also do unnecessary processing. 
[0028] In a preferred embodiment, the execution of the garbage collector 158 may be 
conditioned upon a precise or approximate usage of memory space, thus avoiding unnecessary 
garbage collections. Referring to Figure 4, the JSM 102 is coupled to the MPU 104. The MPU 
104 may be coupled to the garbage collector and may be adapted to run the garbage collector 158 
within the memory 106. In a preferred embodiment, the JSM 102 may include the memory usage 
counter 168, where the memory usage counter 168 may be capable of monitoring the memory 
consumption for one or more programs. More specifically, the memory usage counter 168 may be 
adapted to increment according to the consumption of the allocated memory for the programs. The 



counter may be capable of incrementing until reaching a programmable threshold value 166, where 
the programmable threshold value 166 is a value indicating the allotted memory allocation for a 
program and thus, may vary from program to program. Upon reaching the threshold value 166, the 
memory usage counter 168 may send a request for garbage collection. In some embodiments, the 
JVM may also monitor the counter value to decide when to launch the garbage collector 158. The 
garbage collector 158 may thus access memory 106 and free consumed memory space not needed 
by the programs anymore. The amount of "recycled" memory space may then be re-allocated to 
the programs. The counter may be decremented accordingly to reflect the freed memory space. 
[0029] In Java, specific instructions may request memory allocation but these instructions do not 
encode within their respective Bytecode the amount of memory requested. Instead the JVM must 
look for this amount within Java data structures (e.g., Java class) before allocating the memory or 
sending a request to the operating system on which the JVM runs. 

[0030] In a first embodiment, the decoder 152, when decoding a Java "New" or "New Array" 
Bytecode, or any of the other Java Bytecode requesting new memory, provides a signal to update 
the hardware-implemented, memory usage counter 168 by a determined value. However, since 
these Bytecodes belonging to the standard Java instruction set do not specify the amount of 
memory needed directly, an approximated value is used to update the memory usage counter 168, 
while the precise memory allocation is done by software by the JVM. The approximate value may 
be one where the memory usage counter 168 may count the number of memory allocation request 
rather than the precise amount of memory used to initiate the garbage collector. The approximate 
value may be an average value for the object size used by the current program to give a more 
precise indication to the garbage collector or to the task initiating the garbage collector. 



[0031] Java Bytecodes, such as "New" Bytecode, "NewAiray" Bytecode or any other Bytecode 
requesting some memory allocation are complex Bytecodes when executed by the JSM 102 and 
may be replaced by a micro-sequence. In a second embodiment, the micro-sequence, replacing the 
Java Bytecodes, may be utilized to precisely update the memory usage counter. The micro- 
sequence may retrieve the exact number of bytes required for the memory allocation within a Java 
data structure (e.g. Java class) and consequently may update the memory usage counter 168 
precisely as a part of or before the memory allocation request. 

[0032] In either previously described embodiments, the value of the memory usage counter 160 
may be compared to that of a threshold value 166, and upon approaching the threshold, the JSM 
102 may send to the MPU 104 an interrupt signal, which indicates the need for garbage collection. 
The MPU 104 may then initiate the garbage collector 158 in the memory 106, where the garbage 
collector may evaluate memory 106. After freeing consumed memory resources that may not be 
needed, the memory usage memory usage counter 168 may be updated. The memory usage 
counter 168 may now again be used to monitor the memory consumption and may be incremented 
as described above. 

[0033] In another embodiment, where the counter is updated by software, the software being 
executed on the JVM 108, the MPU 104, or a micro-sequence executed on the JSM 102, the 
memory usage counter may also be a value in memory. As such, the garbage collector must poll 
this value instead of receiving an interrupt from the memory usage counter, implemented in 
hardware, and then compare the value to a threshold value. As such, the MPU 104 may utilize 
interface 170 to access the memory counter 168. 

[0034] By utilizing a counter which monitors the memory consumption of the programs, the 
garbage collector may only be initiated when memory resources are becoming rare and memory re- 



collection is likely to be needed and useful. The preferred embodiments therefore reduce the 
number of times the garbage collector is executed. The power consumption of the overall system 
is reduced as well as the throughput of the processor is increased. 

[0035] While the preferred embodiments of the present invention have been shown and described, 
modifications thereof can be made by one skilled in the art without departing from the spirit and 
teachings of the invention. The embodiments described herein are exemplary only, and are not 
intended to be limiting. Many variations and modifications of the invention disclosed herein are 
possible and are within the. scope of the invention. Accordingly, the scope of protection is not 
limited by the description set out above. Each and every claim is incorporated into the 
specification as an embodiment of the present invention. 



